WIP: Descheduling framework PoC #781

ingvagabund · 2022-04-06T21:59:08Z

providing PoC for Descheduler Framework Proposal #753
the same strategy can be configured differently through different profiles: Multiple descheduler strategies of the same type #486

following up on the v1alpha2 config: Multiple descheduler strategies of the same type #486
Example:

apiVersion: descheduler/v1alpha2
kind: DeschedulerPolicy
profiles:
- name: ProfileName
  pluginConfig:
  - name: DomainFilter
    args:
      namespaces:
        included:
        - namespace-1
        - namespace-2
        excluded:
        - namespace-A
        - namespace-B
      labelSelector: ...
  - name: DefaultEvictor
    args:
      evictSystemCriticalPods: true # default false
      evictFailedBarePods: true # default false
      evictLocalStoragePods: true # default false
      nodeFit: true # default false
  - name: PodsHavingTooManyRestarts
    args:
      podRestartThreshold: 100
      includingInitContainers: true
  - name: LowNodeUtilization
    args:
      lowThreshold:
        cpu : 20
        memory: 20
        pods: 20
      highThreshold:
        cpu : 50
        memory: 50
        pods: 50
  - name: TopologySpreadConstraint
    args:
      includeSoftConstraints: true
  plugins:
    filter:
      # default filters: DomainFilter
      disabled:
      enabled:
    sort:
      # default sorters: Priority
      disabled:
        Priority
      enabled:
        Utilization
    deschedule:
      # plugins descheduling pods without checking other pods
      enabled:
      - PodsHavingTooManyRestarts
      - InterPodAntiAffinity
    rebalance:
      # plugins descheduling pods while balancing distribution
      enabled:
      - Duplicates
      - LowNodeUtilization
      - TopologySpreadConstraint
    evict:
      # default evict plugins: DefaultEvictor
      disabled:
        DefaultEvictor
      enabled:
        CustomEvictor

linux-foundation-easycla · 2022-04-07T13:36:08Z

The committers listed above are authorized under a signed CLA.

✅ login: ingvagabund / name: Jan Chaloupka (2976e15, d0ffe8d, 9b6b266, 228b269, 58209f3, 469480a, e9bc093, c674f0a, 2c38f80)

k8s-ci-robot · 2022-04-16T08:59:05Z

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
To complete the pull request process, please ask for approval from ingvagabund after the PR has been reviewed.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

…ion)

k8s-ci-robot · 2022-05-04T06:46:54Z

@ingvagabund: PR needs rebase.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

k8s-triage-robot · 2022-08-07T12:33:08Z

The Kubernetes project currently lacks enough contributors to adequately respond to all issues and PRs.

This bot triages issues and PRs according to the following rules:

After 90d of inactivity, lifecycle/stale is applied
After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

Mark this issue or PR as fresh with /remove-lifecycle stale
Mark this issue or PR as rotten with /lifecycle rotten
Close this issue or PR with /close
Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

k8s-triage-robot · 2022-10-04T08:48:06Z

The Kubernetes project currently lacks enough active contributors to adequately respond to all issues and PRs.

This bot triages issues and PRs according to the following rules:

After 90d of inactivity, lifecycle/stale is applied
After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

Mark this issue or PR as fresh with /remove-lifecycle rotten
Close this issue or PR with /close
Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle rotten

ingvagabund · 2022-10-10T13:41:43Z

/remove-lifecycle rotten

k8s-ci-robot · 2022-12-12T12:07:00Z

@ingvagabund: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name	Commit	Details	Required	Rerun command
pull-descheduler-verify-master	`d7745ff`	link	true	`/test pull-descheduler-verify-master`
pull-descheduler-unit-test-master-master	`d7745ff`	link	true	`/test pull-descheduler-unit-test-master-master`
pull-descheduler-test-e2e-k8s-master-1-22	`d7745ff`	link	true	`/test pull-descheduler-test-e2e-k8s-master-1-22`
pull-descheduler-test-e2e-k8s-master-1-21	`d7745ff`	link	true	`/test pull-descheduler-test-e2e-k8s-master-1-21`
pull-descheduler-test-e2e-k8s-master-1-23	`d7745ff`	link	true	`/test pull-descheduler-test-e2e-k8s-master-1-23`
pull-descheduler-test-e2e-k8s-master-1-24	`d7745ff`	link	true	`/test pull-descheduler-test-e2e-k8s-master-1-24`
pull-descheduler-test-e2e-k8s-master-1-25	`d7745ff`	link	true	`/test pull-descheduler-test-e2e-k8s-master-1-25`
pull-descheduler-test-e2e-k8s-master-1-26	`d7745ff`	link	true	`/test pull-descheduler-test-e2e-k8s-master-1-26`

Full PR test history. Your PR dashboard. Please help us cut down on flakes by linking to an open issue when you hit one in your PR.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

k8s-triage-robot · 2023-03-12T12:41:31Z

The Kubernetes project currently lacks enough contributors to adequately respond to all PRs.

This bot triages PRs according to the following rules:

After 90d of inactivity, lifecycle/stale is applied
After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
After 30d of inactivity since lifecycle/rotten was applied, the PR is closed

You can:

Mark this PR as fresh with /remove-lifecycle stale
Close this PR with /close
Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

ingvagabund · 2023-03-13T13:01:29Z

/remove-lifecycle stale

knelasevero · 2023-04-04T15:04:02Z

I am closing this one 😅 I think everyone working on the framework had this saved somewhere and no need to keep this POC open :)

/close

k8s-ci-robot · 2023-04-04T15:04:09Z

@knelasevero: Closed this PR.

In response to this:

I am closing this one 😅 I think everyone working on the framework had this saved somewhere and no need to keep this POC open :)

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

k8s-ci-robot added do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. size/XXL Denotes a PR that changes 1000+ lines, ignoring generated files. labels Apr 6, 2022

k8s-ci-robot requested review from lixiang233 and seanmalloy April 6, 2022 21:59

k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Apr 6, 2022

Descheduling framework PoC: flip RemoveDuplicatePods to a plugin

2976e15

ingvagabund force-pushed the descheduling-framework branch from f68d4cf to 2976e15 Compare April 6, 2022 22:04

k8s-ci-robot added size/L Denotes a PR that changes 100-499 lines, ignoring generated files. and removed size/XXL Denotes a PR that changes 1000+ lines, ignoring generated files. labels Apr 6, 2022

ingvagabund added 2 commits April 7, 2022 09:45

Flip RemoveFailedPods into plugin

d0ffe8d

Flip RemovePodsViolatingNodeAffinity into plugin

9b6b266

k8s-ci-robot added size/XXL Denotes a PR that changes 1000+ lines, ignoring generated files. and removed size/L Denotes a PR that changes 100-499 lines, ignoring generated files. labels Apr 7, 2022

ingvagabund added 5 commits April 7, 2022 10:42

Flip RemovePodsViolatingNodeTaints into plugin

228b269

Flip RemovePodsViolatingInterPodAntiAffinity into plugin

58209f3

Flip PodLifeTime into plugin

469480a

Flip RemovePodsHavingTooManyRestarts into plugin

e9bc093

Flip RemovePodsViolatingTopologySpreadConstraint into plugin

c674f0a

ingvagabund force-pushed the descheduling-framework branch from 464bc44 to c674f0a Compare April 7, 2022 13:36

k8s-ci-robot added cncf-cla: no Indicates the PR's author has not signed the CNCF CLA. and removed cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. labels Apr 7, 2022

Flip nodeutilization strategies into plugins

2c38f80

k8s-ci-robot added cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. and removed cncf-cla: no Indicates the PR's author has not signed the CNCF CLA. labels Apr 7, 2022

This was referenced Apr 10, 2022

Descheduler strategies as plugins #557

Closed

Add new podEvictor statistics #648

Closed

ingvagabund added 2 commits April 16, 2022 10:56

Implement default evictor

caab019

Implement v1alpha2

57f565e

ingvagabund added 2 commits April 16, 2022 10:57

Registry + update framework handle

b00cef5

PoC: descheduling profile

4caf6fc

k8s-ci-robot removed the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Apr 16, 2022

ingvagabund added 4 commits April 25, 2022 16:35

Have pluginargs versioned

0089b22

internal version for the configuration

78c1363

Create framework runtime to run all profiles

facb1b7

WIP: Integrate the framework into the descheduler (missing configurat…

d7745ff

…ion)

k8s-ci-robot added the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label May 4, 2022

ingvagabund mentioned this pull request May 25, 2022

Descheduler Framework Proposal #753

Closed

pravarag mentioned this pull request Jun 7, 2022

Descheduling framework: define framework types #837

Closed

12 tasks

Dentrax mentioned this pull request Jun 16, 2022

Improve podEvictor statistics #503

Closed

hormes mentioned this pull request Jul 18, 2022

add descheduler framework proposal koordinator-sh/koordinator#371

Merged

3 tasks

k8s-ci-robot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Aug 7, 2022

k8s-ci-robot added lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. and removed lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. labels Oct 4, 2022

k8s-ci-robot removed the lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. label Oct 10, 2022

k8s-ci-robot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Mar 12, 2023

k8s-ci-robot removed the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Mar 13, 2023

k8s-ci-robot closed this Apr 4, 2023

ingvagabund deleted the descheduling-framework branch April 4, 2023 15:11

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

WIP: Descheduling framework PoC #781

WIP: Descheduling framework PoC #781

ingvagabund commented Apr 6, 2022 •

edited

Loading

linux-foundation-easycla bot commented Apr 7, 2022 •

edited

Loading

k8s-ci-robot commented Apr 16, 2022

k8s-ci-robot commented May 4, 2022

k8s-triage-robot commented Aug 7, 2022

k8s-triage-robot commented Oct 4, 2022

ingvagabund commented Oct 10, 2022

k8s-ci-robot commented Dec 12, 2022

k8s-triage-robot commented Mar 12, 2023

ingvagabund commented Mar 13, 2023

knelasevero commented Apr 4, 2023

k8s-ci-robot commented Apr 4, 2023

WIP: Descheduling framework PoC #781

WIP: Descheduling framework PoC #781

Conversation

ingvagabund commented Apr 6, 2022 • edited Loading

linux-foundation-easycla bot commented Apr 7, 2022 • edited Loading

k8s-ci-robot commented Apr 16, 2022

k8s-ci-robot commented May 4, 2022

k8s-triage-robot commented Aug 7, 2022

k8s-triage-robot commented Oct 4, 2022

ingvagabund commented Oct 10, 2022

k8s-ci-robot commented Dec 12, 2022

k8s-triage-robot commented Mar 12, 2023

ingvagabund commented Mar 13, 2023

knelasevero commented Apr 4, 2023

k8s-ci-robot commented Apr 4, 2023

ingvagabund commented Apr 6, 2022 •

edited

Loading

linux-foundation-easycla bot commented Apr 7, 2022 •

edited

Loading